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Abstract — We study the vector Gaussian CEO problem, and 
obtain the optimal sum-rate that attains any given distortion. 
We show that the evaluation of the Berger-lbng inner bound 
with jointly Gaussian auxiliary random variables is optimal. We 
prove this optimality result by using channel enhancement in 
conjunction with a recent outer bound for the rate-distortion 
region of the vector Gaussian CEO problem. 

I. Introduction 

We study the vector Gaussian CEO problem, where there is 
a vector Gaussian source which is observed through some lin- 
ear additive vector Gaussian channels by an arbitrary number 
of agents. The agents process their observations independently 
and communicate them to a central unit (the so-called CEO) 
through orthogonal and rate-limited links (see Figure [TJ. The 
goal of the agents is to describe their observations to the CEO 
in a way that it can reconstruct the source within a given 
distortion. The trade-off between the rate spent by the agents 
and the distortion attained by the CEO is characterized by the 
rate-distortion region, which is unknown in general. 

The CEO problem is introduced in 1 1 1 for a discrete 
memoryless setting, where the CEO is interested in estimating 
a discrete source with the minimum Hamming distance. Next, 
the scalar Gaussian CEO problem is introduced in |2|, where 
there is a scalar Gaussian source which is observed through 
some linear Gaussian channels by the agents. The CEO 
wants to estimate the Gaussian source with the minimum 
mean square error (MMSE). In 111, it is shown that MMSE 
decays inversely proportionally with the rate expenditure of 
the agents, for sufficiently large number of agents. The scalar 
Gaussian CEO problem is further studied in Q, dU, where the 
entire rate-distortion region is characterized. The achievability 
of this region follows from the Berger-Tung inner bound |5|, 
and the converse proof relies on the entropy-power inequality. 
Recently, [6 | provided an alternative proof for the sum-rate 
of the scalar Gaussian CEO problem without invoking the 
entropy-power inequality. 

Recently, two outer bounds for the rate-distortion region of 
the vector Gaussian CEO problem have been proposed in 121 
and lH). The outer bound in Q is for the two-agent case, 
whereas the outer bound in fSl holds for any arbitrary number 
of agents. Beyond this difference, the proof techniques of these 
two outer bounds are different as well; yielding two different 
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Fig. 1. The vector Gaussian CEO problem. 

outer bounds. In jS], it is shown that the outer bound in Q 
strictly includes the outer bound in |[8|. Nonetheless, when one 
focuses on the sum-rate of the vector Gaussian CEO problem 
as we do here, both outer bounds yield the same lower bound 
for the sum-rate. In lIS), it is also shown that the outer bound 
in |8| is not tight, i.e., it cannot provide the rate-distortion 
region in general. 

In this paper, we consider the sum-rate of the vector 
Gaussian CEO problem and show that the Berger-Tung inner 
bound [5J, when it is evaluated with jointly Gaussian auxiliary 
random variables, attains the optimal sum-rate. We show the 
optimality of the Berger-Tung inner bound for the sum-rate in 
three main steps. In the first step, we optimize the Berger-Tung 
inner bound, and investigate the properties of this optimal 
Berger-Tung sum-rate. In the second step, we improve, i.e., 
enhance, the agents' observations by using the properties of 
the optimal achievable sum-rate obtained in the first step. This 
part is similar to channel enhancement proposed in |9|. The 
optimal sum-rate for the enhanced case provides a lower bound 
for the sum-rate of the original case. Finally, using the recent 
lower bound for the sum-rate given in fS], we obtain the 
optimal sum-rate for the enhanced case, and show that the 
sum-rate of the enhanced case is equal to the sum-rate of the 
original case. 

II. Problem Statement and the Main Result 

In the CEO problem, there are L sensors, each of which 
getting a noisy observation of a source. The goal of the sensors 
is to describe their observations to the CEO such that the 
CEO can reconstruct the source within a given distortion. In 
the vector Gaussian CEO problem, there is an i.i.d. vector 
Gaussian source {Xi}"^j^ with zero-mean and covariance K^. 



Each sensor gets a noisy version of this Gaussian source 



(1) 



where is an i.i.d. sequence of Gaussian random 

vectors with zero-mean and covariance S^. Moreover, noise 
among the sensors are independent, i.e., Ni i, . . . , N^^i are 
independent for all i. The distortion of the reconstructed vector 
is measured by its mean square error matrix 



1 



(2) 



where X" denotes the reconstructed vector. 

An {n, Ri, . . . , Rl) code for the CEO problem consists of 
an encoding function at each sensor /" : M*^><" — > B"^ = 
{1,...,2"^'!}, i.e., Bl' = f^iY^l) where B'l G B^, ^ = 
1, . . . ,L, and a decoding function at the CEO g" : B" x . . .x 



Bl M*^^", i.e., X" = . . . , where M denotes 



the size of the vector Gaussian source X. 

Since the MMSE estimator, which is the conditional mean, 
minimizes the mean square error, without loss of generality, 
the decoding function can be chosen as the MMSE esti- 
mator. Hence, we have X; 
in (|2]i, we get 



E [Ki\{Bl'}f^^] using which 



n 



E 



mmse(Xi|B]",...,BJ 



(3) 



Hence, a rate tuple {Ri,...,Rl) is said to achieve the 
distortion D if there exists an {n, Ri, . . . , Rl) code such that 
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n— ^oo Ti 



i=l 



mmse(X,|B5",...,B£) ^ D 



(4) 



where D is a positive definite matrix. Throughout the paper, 
we assume that the distortion matrix D satisfies 
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-< D -< K 
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(5) 



where the lower bound on the distortion constraint D corre- 
sponds to the MMSE matrix obtained when the CEO has direct 
access to the observations of the agents {Y^jf^^. As pointed 
out in |i8j Appendix A. 2], imposing the lower bound on D in 
© does not incur any loss of generality, while imposing the 
upper bound on D in (|5]l might incur some loss of generality. 

The rate-distortion region TZ(D) of the vector Gaussian 
CEO problem is defined as the closure of all rate tuples 
. . . , Rl) that can achieve the distortion D. 

Here, we study the optimal sum-rate Csum which is the 
minimum necessary sum-rate to attain the distortion D: 

L 
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The main result of this paper is the optimal sum-rate Csum 
of the general vector Gaussian CEO problem, which is stated 
in the following theorem. 



Theorem 1 The optimal sum-rate Csum far the vector Gaus- 
sian CEO problem is 



Cs. 
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(7) 



where the feasible set T) is given by the union of {D^ 
mat rice ^ satisfying 

O^D^^r^S^S £^l,...,L (8) 

L 

^x'+T.^!'^^ ' (9) 



The achievability of the optimal sum-rate Csum can be 
shown by evaluating the Berger-Tung inner bound [51 by 
jointly Gaussian auxiliary random variables ||8j Theorem 2]: 

Lemma 1 (ll8j Theorem 2]) The sum-rate RgJm ^ Sfci 
given by 



nBT ^ 
sum 



1, |Kx^+EtiD7'l 
mm - loe; - — , — - — 
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(10) 



is achievable, where the feasible set is given by the union 
of {Dj^}f^i matrices satisfying 



^ D7' ^ 



= 1, 



(11) 
(12) 
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The converse proof of Theorem [T| uses channel enhance- 
ment in conjunction with a recent lower bound for the 
sum-rate Csum proved in Q, IsJl, which is stated below: 

Lemma 2 ( (Hi) The optimal sum-rate of the vector 
Gaussian CEO problem is lower bounded as 

L 
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(13) 



where T>^ is given by the union of {D^ ^}i=i matrices 
satisfying dZB-dZSl). 

' The notation D7 ^ might lead the reader to think that the inverse of D7 ^ , 
i.e., = (07^)"^ exists. However, here, we use the notation D7^ 
the notational consistency; but not to emphasize that D7 is an invertible 
matrix. In fact, might be positive semi-definite, i.e., we might have that 

1 07^ I = 0, and hence, non-invertible. 

^The outer bound in \1\ and the outer bound in (8| are not identical, and, 
in fact, the former one strictly includes the latter one. However, both these 
outer bounds coincide for the sum-rate. A detailed comparison of these two 
outer bounds can be found in |8j. 



As stated in Q, IHl, the lower bound in Lemma |2] is tight 
if the distortion constraint in ( fT2] l is met with equaUty. Hence, 
in our work here, to obtain the optimal sum-rate Csum, we 
show that for the sum-rate, at the optimality, the distortion 
constraint is met with equality. We prove this by using channel 
enhancement |9 |. However, intuitively, this result can be under- 
stood by noting that both the rate expression in Theorem[T]and 
the rate expression in Lemma |2] are monotonically increasing 
in the positive semi-definite matrices {DJ^}^^^, and hence 
the optimal {D^^lfci matrices should be on the boundary 
of the feasible regions. Consequently, one expects that they 
might satisfy the distortion constraint with equality. However, 
it is not straightforward to verify this intuition, since the 
optimization problems we address are in the form of semi- 
definite programming. 

III. Converse Proof OF Theorem [T] 

Here, we first characterize the optimal Berger-Tung achiev- 
able sum-rate, and next, using the properties of this optimal 
achievable sum-rate in conjunction with channel enhancement 
and the lower bound in Lemma |2l we prove Theorem [T] 

A. Optimizing the Berger-Tung Achievable Sum-Rate 

In this section, we characterize this optimal achievable sum- 
rate i?^"^ given in Lemma [T] (see (fTOli), and the optimal 
covariance matrices attaining Rf^- Since the 

objective function in ( fTOb is continuous and the feasible set 
2?+ is convex, the optimal covariance matrices {'Dj^}f^^ 
should satisfy certain KKT conditions. Now, we obtain the 
KKT optimality conditions. First, we note that the Lagrangian 
for the optimization problem in ( fTol i is given by 
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(14) 



where the positive semi-definite matrices {M^j^^j^, de- 
note the Lagrange multipliers. In (fl4] l. we did not consider the 
constraints D^^ ^ T,J^ because at the optimality, we should 
have D^^ -< S^^, since otherwise, the cost function goes 
to infinity. Using (fl4] l. the KKT conditions that the optimal 
{D^^}^^^, denoted by {'Dj^}f^-^, should satisfy are given 
by 
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(15) 

(16) 
(17) 
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where the first KKT condition in (fTsT i comes from the fact that 
at the optimality, the gradient of the Langrangian in (fT4] i with 



respect to D^^ should vanish V£ G {1, . . . , L}, and the other 
KKT conditions in (fT6]l-(fT7Ti correspond to the complementary 
slackness conditions on the Langrange multipliers. 

Next, we investigate the KKT conditions in ([TsTl-lfTTli. To 
this end, we first introduce some notation. Let A be a 
symmetric positive semi-definite matrix with its orthonormal 
eigenvectors denoted by {/3j}"Li. Let A = J^'jti ^jf^jf^J 
be the spectral decomposition of A, where ta — rank(A) < 
m. We denote span({/3j}^4i) and span({/3j}^^^^;^) by 
span(A) and span(A^), respectively. We note that span(A) 
and span(A^) are orthogonal, i.e., if x £ span(A) and 
y G span(A-'-), then x^y = 0. 

Now, we have the following lemma. 



Lemma 3 



Pi span(M£ 



(18) 



Proof: We prove this lemma by contradiction. Assume 
3x ^ such that x G span(M^). Next, we note that 

since and D^^ commute, i.e., D^^M^ = M^D^^, they 
share the same eigenspace. Moreover, since they are orthog- 
onal, we have the fact that span(M^) and span(D^^) are 
orthogonal. Hence, since, by assumption, x G span(Mf), £ ~ 
1,...,L, we have x^D^^x = 0, i — 1,...,L, which 
implies that 

(k^' + J2 - D"'^ X = xT(K^i - D-i)x (19) 

< (20) 

where we use the assumption that D -< Kx. 

On the other hand, since {D^^lfci have 



K^-i+^D^i-D-i ^0 (21) 

e=i 

which implies that 

x^ ^K^i + J2 - ^'^^ ^ ^ (22) 

which in view of ( |20l i yields a contradiction; completing the 
proof. ■ 
Using this lemma, we can prove the following fact. 



Lemma 4 



(J span(M^ 



(23) 



Proof: We prove this lemma by contradiction. Assume 
3x 7^ such that x G K™ and x ^ |J^^^ span(M^). 
Since x ^ IJ^^-^ span(M^), we should have that x G 
span(M^), £ = 1, . . . , L, which contradicts with Lemma [3j 
completing the proof. ■ 
Next, we have the following lemma. 



Lemma 5 



Proof: To prove this lemma, we need to show 

-11 



X 



X > 



(24) 



(25) 



for all X G R", x^O. 

Pick any x e R™. Since R™ = ULi span(M^) (due to 
Lemma nil, 3£* such that x G span(M^). Now, we consider 
the following 

-11 



x^ - t)j} 



> 



(26) 

(27) 
(28) 



where ( |26] | follows from the KKT condition in ( fTSl l. dZTl i is 
due to the fact that x G span(M^), and ( |28] | follows because 
D^,^ -< S^*^- Equation ( l28T l implies that the condition in (IZST i 
is satisfied; completing the proof. ■ 
Lemma |5] and the KKT condition in (Vh imply that the 
distortion constraint is met with equality: 



Lemma 6 



(29) 



Now, we consider the remaining Langrange multipliers. 
Lemma 7 

^M,, e=l,...,L (30) 

Proof: Using Lemma |5] and the KKT condition in ( fTsT i, 
we have 

- D,-') - M, = M,, - (k~' + I)-'^ (31) 
>- (32) 
which, in view of the fact -D 



^ 0, implies 

(33) 

Using the KKT condition in (fTSI l in ( 1331 ), we get 

- - S^^M^E^i ^ (34) 

which, in view of the facts that >- 0, D^^ >z 0, and 

Mf ^ 0, implies that — >- 0; completing the proof. ■ 



B. A Tight Outer Bound 

In this section, we provide the converse proof of Theorem[T] 
The converse proof has three main steps. In the first step, we 
enhance the observations of the agents by using the properties 
of the optimal Berger-Tung sum-rate. This enhancement pro- 
cess leads to an enhanced CEO problem whose optimal sum- 
rate provides a lower bound for the sum-rate of the original 
CEO problem. This step is similar to the channel enhancement 
proposed in (|9l- In the second step, we use the lower bound 
stated in Lemma |2] to obtain a lower bound for the optimal 
sum-rate of the enhanced problem. Finally, we complete the 
converse proof by showing that this lower bound for the 
enhanced problem is achievable in the original CEO problem. 

First, we define the following covariance matrices 



(35) 



These new covariance matrices have the properties listed in 
the following lemma, whose proof is given in Appendix lAl 



Lemma 8 For all £ ~ 1, . . . , L, we have 

i) O^te^Se (36) 

ii) - ' = - ' - M, (37) 



iii) 



Md - D ^ 



(38) 



IV) | S7^-D7M 's, - fs7^-D7^') ' S7I (39) 



Next, we consider the lower bound for Csum given in 
Lemma |2] To this end, we note the following lemma which 
will be used subsequently. 



Lemma 9 The following function 
3(A) = log 



A- A| 



(40) 



is monotonically decreasing in the positive definite matrices 
A for A A h 0. 

Hence, using Lemma |9] in conjunction with the fact that 
S7^ h S7^ (see ( [36] l in Lemma [8]l in Lemma |2l we have 
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^2'-|S-i-D7i| 
(41) 

= (42) 

2 |D| {■D-^}^;^^ev+ 

Next, we show that the minimum in ( |42] | is attained by the set 
of matrices {D^^j^^j^. To this end, we define 

Af = D7i-D7\ ^ = 1,...,L (43) 



Now, we consider the following difference 

6f = 2/({D7i}ii) - 2/({D7i}ii) 



L 



^ log |(Mi3 - D) A, + I| 



< Llog 

= L log 
= Llog 



-(Mi5-D)^A, + I 



D) 



(44) 
(45) 

(46) 

(47) 

(48) 
(49) 



where ( l46l l and ( l49l l follow from (|38] | in Lemma |8] and we 
obtain (l47l l by using the fact that log | • | is concave in positive 
semi-definite matrices. 

Equation (fT2l l implies that VjD^^jl^j^ G P^, we have 

L L 

^D.-i^D-i-K^i =5^0,-1 (50) 

1=1 1=1 

where the equality follows from Lemma |6] Using (ISOl l and 
the fact that log | • | is monotonically increasing in positive 
semi-definite matrices in ( |49] l. we get 



5f < Llog 



which implies that 

/({D7i}ii)< min /({D.-ijii) 
{DaLief+ 

Using ( |52] | in (|42] |. we get 



^1 |Kx| IS^^I 
1, |Kx| , 



(51) 



(52) 



(53) 



(54) 



(55) 



where (|54l l comes from ( |39T l in Lemma [8] Since i? 



BT 



> 



Cf.. 



i55[ implies Csum = RfSn'^ completing the proof. 



IV. Conclusions 



We show that the Berger-Tung inner bound, when it is 
evaluated with jointly Gaussian auxiliary random variables, 
achieves the optimal sum-rate for the vector Gaussian CEO 
problem. We show the optimality of the Berger-Tung inner 
bound for the sum-rate by using channel enhancement |9 | in 
conjunction with the recent outer bound for the rate-distortion 
region of the vector Gaussian CEO problem in ITjj, ||8J. 



Appendix A 
Proof of Lemma[8] 

Equation (|36] | follows from (|35] | and Lemma [7] 
Next, we consider dSTT i as follows 



-D: 



[I - 



I-(S,-M,)D, 



(Sf - Mi 



(56) 
(57) 
(58) 
(59) 
(60) 
(61) 
(62) 



where dSTl ) and ( l60b follow from the KKT condition in ( fT6] ). 
and ( [62] l comes from the definition of in ( |35] ). 

Equation ( |38] ) can be obtained by plugging ( |37] | into the 
KKT condition in ( fTSl ), and noting Lemma |5] and Lemma |6] 

Finally, we consider ( [39] l as follows 



S7' D 



> -1 ~ 

-1\ V>-1 



S7' = 1- 



S7' -d: 



S7^-D7M 'd71 (63) 



D7^ 



= (S7'-D7M S7' 



(64) 

(65) 
(66) 



where ( l64b comes from ( |37] ). and ( l65T l is due to the KKT 
condition in ( fT6] l. Equation ( |66] | gives us the desired result 
stated in ( l39] i: completing the proof. 
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